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METHOD FOR SEPARATING IMAGE SEQUENCES STORED ON [ MEDIA ] SUPPORTS 
SUCH AS MOTION- PICTURE FILM, VIDEO TAPE OR SUCH LIKE [ INTO 

INDIVIDUAL 3EQUENCE3 ] 

CROSS-REFERENCED TO RELATED APPLICATION 

This application claims priority of International application 
number PCT/DE99/04028 , filed December 10, 1999, which in turn 
claims priority to German patent application^ num^er^l98 .49 087.3, 
filed December 10, 1998. 

FIELD OF THE INVENTION [Description] 

The invention relates to a method for separating image sequences^, 
stored on media such as motion-picture films, video tapes or [su c h] 
the likej_ into individual sequences. 

BACKGROUND OF THE INVENTION 

It is known to manually split successive scenes of a motion-picture 
film or video tape into individual sequences in order to then [to] 
compile, discard or store [these] the individual sequences, if 
appropriate^ in a different order. In this case, the beginning of 
an individual sequence is usually initiated by an individual start 
image or a plurality of start images, for example by the recording 
of a film clapperboard with the assignment noted thereon. 

The image sequences may be contained on various recording media, 
such as motion-picture films, video tapes, or electronic storage 
media^ such as CDs or the like. In many applications, recording is 
effected in parallel on a motion-picture [films] film and an 
electronic storage medium, the electronically stored image sequence 
being reflected out of an optical beam path of a motion-picture 
camera and being converted by means of a video chip or a video 
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camera into video signals which are stored on the electronic 
storage medium. 

US-A-5 , 537, 530 discloses a method for separating image sequences 
stored on video tapes into individual sequences, in which sequence 
changes of a first type which are based on a change in the mean 
brightness of successive images which exceed or fall below a 
predetermined amount and also sequence changes of a_ second type 
which are based on a change in the image content of successive 
images are detected and Reparation markers for the automatic 
separation of the image sequences into individual sequences are 
set . 

In numerous applications, automatic separation of, in particular, 
digitized films into individual sequences is desirabler*without the 
need for manual separation or the recording of start images for 
introducing an individual sequence. In the medical field, in 
particular, such automatic separation of digitized films into 
individual sequences is desirable in order that, directly after 
recording of the image sequences, individual sequences are made 
available for diagnosis. In this case, what is crucially important 
is that firsts no images are lost during the automatic separation, 
and that [ secondly ] second, a high identification rate is achieved 
for resolving the image sequence into individual sequences. 

SUMMARY OF THE INVENTION 

The -f-ft — irs — an — ob j e c t — of — the] present invention -fbo — specify] 
provides a method for automatic separation of image sequences , in 

particular of digitized motion-picture films, video recordings or 
[■srtch] the like, which guarantees a highest possible identification 
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rate of the individual sequences and ensures that no images are 
lost during application of the separation method. 

[This ob j ect is achieved a c c o rding to th e inv e ntion by m e ans o f th e 
f e atures of Claim 1 . ] 

The solution according to the invention [first guarantees a high e st 
possible] first maximizes an identification rate of the individual 
sequences and second [ se c ondly ensur e s ] maximizes the retention of 
all the images of the image sequences of a motion-picture film, 
video tape or [su c h] the like. 

The solution according to the invention is suitable^ in particular^ 
for realization in a data processing device with corresponding 
hardware components and can be used both for stand-alone 
applications and in network systems and also for remote data 
transmissions. 

[Advantageous refinements of the method according to the inv e ntion 
can be gathered from the features o f the subclaims. 

irt — the] In one practical application, it [prov e s — to — be-}- is 
advantageous to display a selected individual image, preferably the 
first individual image in each [c ase , — o f an ] individual sequence^ 
as an icon on a monitor, so that [tte] a relevant individual 
sequence can be started by clicking on the icon. A sequence of 
individual sequences can be started for viewing by successively 
clicking on a plurality of such icons. 



DETAILED DESCRIPTION OF THE INVENTION 
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The concept underlying the invention will be explained in more 
detail below using an exemplary embodiment. 

For the application of the method according to the invention and of 
the software derived therefrom for automatically separating 
digitized cardiological films into individual sequences, 35 mm 
motion-picture films and S-VHS video tapes are used as media in the 
exemplary embodiment. A total of three types of^sequence changes 
can be observed on these media: 

1. On 35 mm motion-picture film (negative) two to three virtually 
white images, often up to three such sequence changes at short 
intervals (approximately three images) one after the other; 

2. On video tape up to 30 virtually black image sr : i " " 

3. On video tape, at the end of the sequence, 10 to 15 
-disregarding noise - identical individual images, then start 
of the next sequence without specially marked intermediate 
images . 

The first two sequence changes (1 and 2 above) are designated below 
as sequence changes of the first type, and the third sequence 
change -E-ere— H3 above) is designated below as a sequence change of 
the second type. [These] The sequence changes of the first and 
second types are handled as follows: 



Sequence changes of the first type^ which are based on a great 
change in the mean brightness^ can be identified very reliably-f-rht. 
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i.e. with good image material it is possible to achieve an 
identification rate of 100%. 

[The — separation ] Separation of image sequences is effected by 
setting separation markers of first and second types or sequence 
changes of the first and second types. A separation marker of the 
first type is a predetermined number of successive black or white 
images. The images identified as separation .mark^xe^ar.e. themselves 
not stored. The first image after the separation marker is also the 
first image of the next sequence. The sequences themselves must 
contain at least a predetermined number of images, otherwise they 
are discarded. 

Sequence changes of the second type^ which are based on a change in 
the image contents are significantly more difficult to identify 
than sequence changes of the first type since the size of the 
change varies and large deviations between successive images can 
occur even within a sequence. In many applications, [only] an 
identification rate of only approximately 75% is achieved for 
sequence changes of the second typ e, i.e. not all sequence changes 
are identified as such and occasionally separation is performed 
within a sequence. [It] However , even i f this occurs , it is 
guaranteed-h — however, ] that no images are lost . 

The separation is effected according to the following rules: 

a) - A separation marker of the second type is an image whose 
content differs greatly from the contents of [tire] its 
preceding images; 
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b) Separation markers of the first type always have priority over 
separation markers of the second type ; 

c) Separation markers of the second type [whi c h] that are 
situated within a predetermined [ distan ce] number of images 
from separation markers of the first type are not taken into 
account ; 

d) A separation marker [ S ep aration mark e rs ] of the second type 
[are] is not taken into account if [trfcre] its preceding 
sequence does not contain at least a predetermined number of 
images ; 

e) [The] An image identified as a separation marker is the first 
image of the next [ image ] sequence . 

To set the behavior of the automatic separation method, the most 
important parameters - specified below - and also the following 
file names are set or specified in a file "splitter.ini": 

a) The parameter MeanMinFrames specifies the [least] minimum 

number of images that must be contained in the individual 
sequences [which] that are terminated by separation markers of 
the first type. [Shorter s e qu e nces] Sequences that have less 
than the minimum number of images are discarded. *f 
}-Since many films only contain very short sequences with the 
insertion of the patient's name (clapperboard), given an internal 
predetermined value of 12 and a range of values > 0, a range of 
values for this parameter of 4 to 6 is recommended. 
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b) The parameter MeanSpltFrames specifies the [least] minimum 
number of images that a separation marker of the first type 
must comprise in order that separation is performed. [Th e ] 
This predetermined value is 2, the range of values is > 0. 

c) The parameter MeanSensitivity indicates the response 
sensitivity for separation markers of the first type from low 
to high with a range of values from 0.0 to 1...0* t .The value 0.0 
denotes no checking for this criterion. In order that the 
beginning of a new sequence whose brightness differs greatly 
from that of the preceding sequence can be reliably 
identified, this value must not, however, be too high. Within 
the range of values specified above, a range of values from 
0.2 5 to 0.35 is recommended. 

d) The parameter ChangeMinFrames specifies the [l e ast] minimum 
number of individual images that must be contained in 
sequences [which] that are terminated by separation markers of 
the second type . [In the case of shorter sequences] When a 
sequence has less than the minimum number of individual 
images , the separation marker is discarded. Moreover, all 
separation markers of the second type are discarded which do 
not have at least this [distan c e] minimum number of individual 
images from separation markers of the first type. Preferably, 
[the] this predetermined value is 12 given a range of values 
of > 0. 

e) The parameter ChangeSensitivity indicates the response 
sensitivity for separation markers of the second type. Given 
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a range of values from 0.0 to 1.0, where the value 0.0 denotes 
no checking for this criterion, the value 0.7 is recommended 
for average video material . 

f) The file SpItDatpath ("splitmarks.dat") indicates the file 
into which a list of separation markers is written. It is 
preferably valid only for a debug version of the program. 

g) The file SeqDatPath ("sequences.dat") denotes the file in 
which the sequence list is stored unless a different file name 
was specified on the command line. 

The automatic sequence separation can be activated separately for 
each video source in a set up window of a recording software. It is 
effected after the storage of the raw data on "a hard "disk and prior 
to further processing to form DICOM data records. In this case, the 
processing speed is approximately 500 to 1000 images per second. 
The complete path name of the program "splitter . exe" is entered as 
a parameter in the file VIM. IM of the recording software. 

In a standard installation directory for the files "splitter.exe" 
and "splitter.ini", the following files are generated in accordance 
with *th§ presetting: 

1. A logging file "splitter.log"; 

2. A list of the separation markers "splitmarks.dat" for a debug 
version; 

3. A list of the individual sequences "sequences.dat". 
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In order to form the algorithm, each image is firstly examined with 
regard to separation markers of the first type. If no such marker 
is found, a search is made for separation markers of the second 
type. Once a provisional list for the possible separation markers 
has been created in this way, post -processing is effected in order 
to determine the individual sequences. 

The function CheckSplitMean is used to find the separation markers 
of the first type. A moving mean value (MeanMean) of the image 
brightnesses is calculated in each case over the last 16 
(MEANFRAMES) images. From said mean value and the parameter mean 
sensitivity, a lower (LThresh) and upper (UThresh) threshold value 
are determined as follows: 

LThresh = MeanSensitivity * * MeanMean^'''*' t w 

[UTresh] UThresh = 255 - MeanSensitivity * (255 - MeanMean) 

If the mean value of the current image exceeds UThresh, then a 
white separation marker (SPLT_WHITE) is set, and if +rb — falls 
b e low] the mean value of the current image is less than LThresh, 
then a black separation marker (SPLT_BLACK) is set. In this case, 
the mean values of the separation marker images do not enter into 
the moving average . 

The function CheckSplitChange is used to find separation markers of 
the second type by calculation of the RMS deviation (CurrRmsDif f ) of 
the pixel brightnesses between the current image and the preceding 
image. A moving mean value (MeanRmsDif f ) of the RMS deviations is 
determined over the last 16 (MEANFRAMES) image changes and from 
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this and from the parameter ChangeSensit ivity a threshold value 
(Diff Thresh) is determined as follows: 

Diff Thresh = (8 - 6 * ChangeSensitivity) * MeanRmsDif f 

If the RMS deviation of the current image change exceeds the 
threshold value, then a separation marker (SPLT_CHANGE) is set. RMS 
deviations of separation markers of the second ^tijpe^enter into the 
moving mean value, but those of the first type do not. 

The function EvaluateSplit is used to determine the individual 
sequences from the separation marker list with the following 
proviso: 

1. All separation marker sequences of the -first "type -which are 
shorter than the number MeanSpltFrames of images are 
discarded. 

2. All separation markers of the second type which lie nearer to 
the remaining separation markers of the first type than 
ChangeMinFrames images are discarded. 

The individual sequences thus formed start 

1. with the first image in the filejL or 

2. with the first image after a separation marker of the first 
typej_ or 

3. with a separation marker of the second type3j_ 
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and end 

1. with the last image in the file or 

2. with the last image before a separation marker of the first 
type, if it is at least MeanMinFrames images long, otherwise 
the sequence is discarded, or 

3. with the last image before a separation marker of the second 
type, if it is at least ChangeMinFrames images long. 
Otherwise, the separation marker is discarded. 
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ABSTRACT 

The invention relates to a method for separating successive image 
sequences of motion-picture films, video tapes or the like into 
individual sequences. According to said method, sequence changes 
of a first type, which are based on a change in the mean brightness 
of successive images, and/or sequence changes of a second type, 
which are based on a change in the content of successive images, 
are detected and separation markers for the automatic separation of 
the image sequences into individual sequences are set. 
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